Creation and Analysis of a Reading Comprehension Exercise Corpus: Towards Evaluating Meaning in Context
نویسندگان
چکیده
We discuss the collection and analysis of a cross-sectional and longitudinal learner corpus consisting of answers to reading comprehension questions written by adult second language learners of German. We motivate the need for such task-based learner corpora and identify the properties which make reading comprehension exercises a particularly interesting task. In terms of the creation of the corpus, we introduce the web-based WELCOME tool we developed to support the decentralized data collection and annotation of the richly structured corpus in real-life language teaching programs. On the analysis side, we investigate the binary and the complex content-assessment classification scheme used by the annotators and the inter-annotator agreement obtained for the current corpus snapshot, at the halfway point of our four-year effort. We present results showing that for such task-based corpora, meaning assessment can be performed with reasonable agreement and we discuss several sources of disagreement.
منابع مشابه
On the Creation and Analysis of a Reading Comprehension Exercise Corpus: Evaluating Meaning in Context
متن کامل
The impact of gender on using reading sub skills in Iranian EFL learners reading comprehension
The present study was an attempt to investigate the impact of gender on using reading subskills and reading comprehension skill of Iranian EFL learners. To this end, four subskills involved in the reading comprehension process were selected. Then some reading passages whose comprehension questions were believed to measure the intended subskill were chosen. Eighty-eight EFL adult upper-intermedi...
متن کاملA Critical Study of Current Views of the Stages of Human Creation in the Holy Quran
On compatibility or incompatibility of the Qur'an with evolutionism, numerous studies are found. They, however, lack methodological properties, comprehensiveness with regard to the related verses as well as the accuracy This study focuses on the verses of the origin and stages of human creation with a comprehensive look at all related verses and its classification. After extracting the stages o...
متن کاملIntegrating Parallel Analysis Modules to Evaluate the Meaning of Answers to Reading Comprehension Questions
Contextualized, meaning-based interaction in the foreign language is widely recognized as crucial for second language acquisition. Correspondingly, current exercises in foreign language teaching generally require students to manipulate both form and meaning. For Intelligent Language Tutoring Systems to support such activities, they thus must be able to evaluate the appropriateness of the meanin...
متن کاملPedagogy of Possibility for EFL Learners: Principles, Application, and Course Development
This study reports on the development of a reading comprehension course based on Critical Pedagogy principles, and the result of its application on EFL learners' reading comprehension competence, their motivation to read English materials, their democratic attitudes towards their English classrooms, and also their attitudes towards the critical course. The present study is, in fact, a step forw...
متن کامل